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ABSTRACT 


The  space  of  ellipsoids  may  be  metrized  by  the  Hausdorff  distance 
or  by  the  sum  of  the  distance  between  their  centers  and  a  distance  between 
matrices.  Various  inequalities  between  metrics  are  established. 

It  implies  that  the  square  root  of  positive  semidefinite  symmetric 
matrices  satisfies  a  Lipschitz  condition,  with  a  constant  which  depends 
only  on  the  dimension  of  the  space. 

Key  words 
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1.  Distance  between  ellipsoids  as  sets. 

Ellipsoids  in  Rn  may  be  viewed  as  elements  of  the  set  of  subsets 
of  Rn,  subsets  which  could  be  restricted  to  be  compact,  convex  and 
centrally  symmetric.  The  set  of  subsets  of  Rn  is  usually  metrized 
by  the  Hausdorff  metric  [2] : 

6(F,F)  »  Max{sup  Infix  -  yl ,  Sup  Infix  -  yl} 
y€p  xGe  xGe  yQ? 

=  Inf{5  >  0  :  E  +  5S  D  F,  F  +  6S  3  E>  , 

where  E  and  F  are  subsets  of  Rn,  It  I  represents  the  Euclidean 
norm,  and  S  =  {x  G  Rn  :  Ixi  £  l}  is  the  unit  ball. 

If  E  and  F  are  convex,  then 

fi(E,F)  =  Sup{lh(x,E)  -  h(x,F)l  s  Ixi  =  l}  , 

where  h(x,E)  =  Sup{ (x,y)  :  y  6  e)  is  the  support  function  of  E  (see 
Bonnensen-Fenchel  [1])  and  (.,.)  denotes  the  scalar  product. 

If  E  and  F  are  convex  and  contain  the  origin  in  their  interiors, 

then 

6  (E,F)  =  Sup{fg(x,Ed)  -  g(x,Fd)l  s  Ixi  =  l} 
where  Ed  =  {x  G  Rn  :  (x,y)  <  1  Yy  6  e}  is  the  dual  of  E,  and 

g(x,Ed)  =  Inf{y  ^  0  :  x  G  MEd} 

is  the  distance  function,  or  gauge,  of  Ed;  this  follows  because 
h(x,E)  =  g(x,Ed) . 

If  E  and  F  are  convex,  full-dimensional,  and  centrally  symmetric 
with  respect  to  the  origin,  then  Ed  and  Fd  inherit  the  same 
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properties,  and  g(x,Ed)  and  g(x,Fd)  define  norms  on  Rn.  Thus  S(E,F) 
may  be  viewed  as  a  distance  between  norms  on  Rn. 

The  Hausdorff  distance  is  invariant  under  congruent,  but  not  affine, 
transformations,  and  reduced  by  projection.  It  will  be  assumed  throughout 
that  the  space  of  ellipsoids  contains  the  degenerate  ellipsoids.  The 
space  of  ellipsoids  is  not  closed  under  addition. 

The  following  lemma  indicates  that  it  will  be  sufficient  to  study 
ellipsoids  centered  at  the  origin. 

Lemma  1 

Let  E  and  F  be  two  subsets  of  Rn,  compact,  convex  and  symmetric 
with  respect  to  the  origin;  let  E1  =  e  +  E  and  F1  =  f  +  F,  then 

(SfE^F1)  <  <S(E,F)  +  lle-f#  <  26(E1,F1) 

5(E,F)  <  afE^F1)  He-f  II  <  S  (E1  ,K1)  . 


Proof: 

^(E^F1)  =  Sup{jh(x,E1)  -  h^F1)]  :  Ixl  =  l} 

=  Sup{jh(x,E)  -  h (x,F)  +  (e-f ,x) |  :  DxH  =  1} 

<  Sup{jh(x,E)  -  h(x,F) |  :  Bxl  =  1}  +  Sup{| (e-f,x) |  :  »xl  =  l} 
=  6(E,F)  +  I  e-f  I  . 

Conversely 

-6 (E1, F1)  <  h(x,E)  -  h(x,F)  +  (e-f ,x)  <  6 (E1,F1)  V|x|  =  i  . 
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now  h(x,E)  ■  h(-x,E)  and  h(x,P)  =  h(-x,F)  as  E  and  F  are  symmetric 
with  respect  to  the  origin,  and  thus 

-fitE^F1)  <  h(x,E)  -  h(x,F)  -  (e-f ,x)  <  StE1,?1)  Vlxl  =  1  . 

Adding  and  subtracting,  one  gets: 

-6 (E1,?1)  <  h(x,E)  -  h(x,F)  <  fitE1,?1) 

-6 (E^,F^)  <  (e-f ,x)  <  ajE1,?1)  vlxl  =  1  , 

and  hence  S(E,F)  <  SfE1,?1)  and  le-fl  <  6(E1,F1).  QED. 

2.  Ellipsoids  as  vectors  and  matrices. 

Ellipsoids  may  also  be  represented  by  a  vector  (its  center)  and 
a  matrix  (its  size,  shape  and  position) : 

E  *  e  +  AS  **  {x  €  Rn  :  x  =  e  +  At,  Itl  =  l}  ; 

note  that  h(x,E)  »  (e,x)  +  Is^xl.  If  A  is  nonsingular,  then: 

E  *  {x  Rn  :  (x-e)T(AAT)  1  (x-e)  <_  l}  . 

To  any  ellipsoid  is  associated  an  equivalence  class  of  matrices; 

in  fact  E*e  +  AS*e  +  AS  if  arid  only  if  A  *  AO  where  0  is  an 

orthogonal  matrix,  or  equivalently  if  AA^  *  AA7.  Define  now  H  =  AA7 , 

1/2 

and  A  *  H  ,  then,  in  the  remainder  of  this  paper  an  ellipsoid  will 
be  defined  by 

E-e+AS-e+  H1/2S 


where  A  and  R  are  positive  semidefinite  symnetric  matrices.  Using 
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any  of  these  two  definitions  there  exists  a  one-to-one  correspondence 
between  ellipsoids  and  points  (e,A)  in  Rn  x  p(Rn)  (respectively 
(e,H)  £  Rn  x  p(Rn)),  where  p(Rn)  is  the  set  of  n  x  n  positive  semi- 
definite  symmetric  matrices. 

One  could  have  tried  to  associate  to  an  ellipsoid  a  lower  triangular 
T 

matrix  L(H  =  LL  );  L  is  unique  if  H  is  nonsingular,  but  not  necessarily 
so  if  H  is  singular.  This  is  the  key  reason  why  the  results  of  this 
paper  will  not  extend  to  the  case  of  Cholesky  factors. 

If  A  is  nonsingular,  then 

E  =  {x  G  Rn  :  (x-e)TA  2(x-e)  <_  1} 

=  {x  €:  Rn  s  (x-e)TH  ^(x-e)  £  l}  . 

We  may  now  define  two  matric  distances  on  the  space  of  ellipsoids. 

Let  E=e+AS=e+  H1/2S  and  F=f+BS=f+  K1/2S  be  two 
ellipsoids  in  Rn,  where  A,  B,  H  and  K  are  positive  semidefinite 
symnetric  matrices,  then  define: 

d(E,F)  =  le-fl  +  Ia-bI 

A  (E,F)  =  le-fl  +  Ih-kI1^2  =  le-fl  +  Ia2-B2I ly/2  , 

where  1  I,  for  matrices,  is  the  spectral  norm. 

It  is  clear  that  d  and  A  satisfy  the  axioms  for  a  metric  (or 
distance) . 

Various  inequalities  between  d,  A  and  5  will  be  proved  in 


the  next  section;  the  relationship  between  d  and  6  is  the  closest 
one,  as  d  and  $  are  related  by  inequalities  involving  constants 
depending  only  vqpon  the  dimension  of  the  space. 
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The  inequalities  imply  that  the  three  metrics  define  the  same 
topology  on  the  space  of  ellipsoids,  but,  more  strongly,  that  rates  of 
convergence  can  be  related. 

The  inequalities  between  d  and  6  imply  that  the  rates  of  con¬ 
vergence  of  a  sequence  of  ellipsoids  may  be  studied  within  a  space  of 
sets,  or  a  space  of  matrices,  and  that  the  two  rates  are  identical. 


3.  Inequalities  between  distances. 

If  E  and  P  are  ellipsoids  centered  at  the  origin,  and  E^-  =  e  +  E, 
F1  =  f  +  F,  then 

dtE^F1)  =  He-fll  +  d(E,F) 

A  (E'Sf1)  =  le-fl  +A(E,F)  ; 

and  Lemna  1  indicates  that  it  is  enough  to  study  ellipsoids  centered 
at  the  origin.  In  that  case: 

d(E,F)  =  i a-bB 

A(e,f)  =  Nh-kI1/2  =  Ia2-b2I1/2 
6 (E,F)  =  Sup{|Iax!  -  RbxI I  :  lx!  =  1}  . 

Theorem  2 

Let  E  =  AS  and  F  =  BS  be  two  ellipsoids  in  Rn,  centered  at 
the  origin,  where  A  and  B  are  n  x  n  positive  semidefinite  symmetric 
matrices,  then: 

Jc^Ia-bI  £  Sup{  j  I  Ax  I  -  IbxI|  :  Ixl  =  l}  <_  Ia-bI 
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or 


8 (E,F)  <  d(E,F)  <  k  8 (E,F) 

—  —  n 

where  k^  =  2\/?n(n+2)  . 

Proof ; 

For  the  first  part,  one  has 

| IaxI  -  IbxB |  £  Iax-bxB  =  I (a-b)xB  Ba-bBBxB  , 

and  Sup{ I  I Ax I  -  IbxB |  :  IxB  =  l}  <  Ia-bI. 

For  the  second  part,  let  8  =  Sup{|lAxl  -  IbxBJ  :  llxl  =  l} ,  and 

o  <a  ,<•••<  a,, 0  <0  ,<***<0,  be  the  ordered  eigenvalues 

n  —  n-i  —  —In—  n-l  —  —  l 

of  A  and  B  (clearly  all  real  and  nonnegative  numbers) . 

The  maximum  characterization  for  the  eigenvalues  of  Hermitian 
matrices  gives: 

2  T  2 

a  =  Max  Mm  x  A  x  , 

where  represents  the  intersection  of  any  k  dimensional  subspace 

with  the  unit  spherical  surface;  assume  \_hat  S*  gives  the  maximum. 
Now  define  x*  by 

T  2  T  2 

x*  B  x*  =  Min  x  B  x  . 

x<=S  * 
k 


0?  =  Max  Min  xTB2x  Min  xTB2x  =  Ibx*I2 


Thus 
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and 


a,  =  Min 
XGS* 


T_2 
x  A  x 


it  follows  that 


ak  -  gk  <  «Ax*»  -  lBx*l  <  6  . 

<  6,  and  |ak"3k 

The  content  of  the  theorem  is  unchanged  if  A  is  replaced  by 
T  T 

O  AO  and  B  by  0  BO,  where  0  is  any  orthogonal  matrix;  hence  we 
may  assume  that  A  is  diagonal,  and  that 


Reversing  the  argument,  $k  - 


|  £  5  vk  =  1,  . . . ,  n. 


a .  =  a . .  Vi  =  1 ,  . . . ,  n  . 
l  n 

Denote  by  Bk  =  Bek  the  kth  column  of  B,  where  ek  is  the  k^*1 
column  of  the  identity  matrix;  then 

1  cx^  -  1 B  J  =  |  iAekl  -  lBekl|  <5  Vk  =  1,  ...»  n  . 

Hence 


|Pk  -  lBkB I  <  |ek-ak|  +  |ak  -  *BkI|  <25  Vk  -  1,  ...»  n  . 


Now 


0  < 


kk 


thus 
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o  <  I  (*Bkl  -  bj^)  =  l  (#BkI  -  3k)  <  l  Mb.  I  -  ek|  <  2nd  , 

k=l  k=l  k=l 


implying  that 


0  £  ~  bkk  <  2nd  Vk  =  1,  n  . 


This  leads  to: 


l“k"bkk!  -  iak"8kl  +  '  ,Bk*I  +  I'V  ■  bkki  -  (2n+3>6  • 


Let  D  =  Diag  (b^) ,  and  x  be  any  vector  of  unit  length,  then: 


BbxI  -  iDxll  <  I Ibx!  -  I Axil  +  | I Ax I  -  IdxI| 


<  d  +  Ia-dI  <  d  +  (2n+3)d  =  {2n+4)d  , 


Ia-dI  =  Max  la]c"bkkl  -  <2n+3>5 


k=l, . . . ,n 


It  remains  to  show  that  the  off  diagonal  elements  of  B  are  bounded 


by  a  multiple  of  d.  If  b^  =  0,  or  bkk  =  0,  then  b^k  =  0  (i  /  k) 
2 

as  b^k  £  biibkk  b^  semidefiniteness  of  B.  So  assume 

that  b. .  >  0,  b. ,  >  0,  and  let  a  =  b.  .  ,  b  =  b, .  ,  c  =  lb..  I  and 
ix  kk  n  kk  lk 

a  =  +1  (resp.  -1)  if  b^k  is  positive  (resp.  negative) . 


Choose  z  = 


/  2  .  .2 

r  a  +  b 


(be^  +  Cfaek) : 


|Bz|  =  — IbB.  +  aaB,  I 

vffi?  1 


- -  l(ab+ac)e.  +  o(ab+bc)e.  +  7  (bb.,  +  crab..  )e.l 

j^i,k  31  3k  3 


42+b2 
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1 

^ — i -  l(ab+ac)e.  +  cr(ab+bc)  e.  H  i 

/ST2  1  I 

1  22  1/2 
=  - - -  ((ab+ac)  +  (ab+bc)  )  ' 

v4W 


.  2  .  abc (a+b)  ,  „  a2b2 
=  |c  +  2  - r  +  2  - - ^ 

a+b  a+b 


1/2 


/Jab 


*1 


where  this  last  equation  defines  d  (d  >  0) . 

/Jab 


Now,  as  6dzJ  = 


,  it  follows  that  d  <  IbzI  -  IdzI  <  (2n+4)6. 


/a+b2 


The  value  of  d  is  given  by  the  positive  root  of 


,2  .  2 /Jab  ,  2  .  2abc (a+b) 

d  +  .  ..  .  d  =  c  +  — - - —  ; 

2«,2  •  *  b2 


v£ 


the  left-hand  side  increases  with  d  (d  >  0)  and  is  less  than  the 
right-hand  side  for  d  =  0  and  d  =  c//F,  implying  that  the  value  of 
d  is  greater  than  c//J,  and 


c  <  d/J  <  2/7(n+2)5  . 


Thus  |b^jJ  5.  2/2{n+2)<5,  Vi,k,  i  ^  k,  and 
lA-Bl2  <  Tr(A-B)2 

=  I  (akk-bkk)2  +  ll.  bik 

k  i  /  k 

<  n{2n+3)262  +  n(n-l)8(n+2)262 

<  8n2(n+2)262  ; 


i 


hence  Ia-bI  <  2v/2n(n+2)6.  QED 
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The  next  result/  which  compares  the  distances  6  and  A,  uses 
an  operator  theory  proof,  and  hence  carries  to  infinite  dimensional 
Hilbert  spaces. 

Theorem  3 

1/2  1/2  n 

Let  E  =  H  S  and  P  =  K  '  s  be  two  ellipsoids  in  R  ,  centered 

at  the  origin,  where  H  and  K  are  positive  semidefinite  symmetric 

matrices ,  then 

S(E,F)  <  Ih-kI1/2  <  I62(E,F)  +  fi(E,F)Max(D(E) ,D(F))]1/2  , 
where  <S(E,F)  =  Sup{  |  (xTHx) 1/2  -  <xTKx)1/2|  s  M  =  l},  A  (E  ,F)  =  Ih-kI1/2, 

1  /9 

and  D(E)  =  2IhI  '  is  the  diameter  of  E;  it  may  also  be  written  as: 
Ih-kI/[(1h-kI  +  Max(lHl ,IkI))1/2  +  (Max(lHl,lKi))1/2] 

<  6 (E,F)  <  »H-k81/2  . 

Proof: 

Let  6  -  6(E,F);  thus: 

(xTHx)V2  -  (xTKx)1/2  <5lx|  Vx  , 

hence 

xTHx  <  52lxl2  +  25lxl (xTKx) *^2  +  xTKx  Vx  , 

<  62ixl2  +  xTKx  +  t  162lxl2  +  e(xTKx)  Vx,  ve  >  0 
=  62(l+e  ^Ixl2  +  (1+e)  (xTKx)  vx,  ve  >  0  . 


We  have 


xT(h-k)x  <  xT(62(l+e  1)l  +  eK)x  vx,  ve  >  0  , 


and  similarly,  reversing  the  argument , 


xT(H-K)x  >  -xT(<S2(l+n-1)I  +  qH)  x  Yx,  YTl  >  0 


These  two  equations  imply  that 


Ih-kI  <  MaxCelKl  +  62<l+e-1) ,qiHl  +  6z(l+q~'L)}  Ye  >  0,  yq  >  o 


2 ,,  -1, 


taking  e  =  6/IhI1  2  and  q  =  5/1kI  ,  one  gets 

Ih-kI  <  62  +  26  Max(lHl1/2,lKll1/2)  . 


For  the  second  part,  let  A'  !  =  Ih-kI,  thus 


using  the  inequality 


|xT{H-K)x|  <A2»xI2  yx  f 


i-b(  <  a^-b2|  (a,b  >  0) 


one  gets 


|(xTHx)1/2  -  (xTKx)1/2|  <  AlxS 


6  (E,F)  =  Sup{ |  {xTHx)  1/2  -  (xTKx)  1/2 1  :  Ixl  =  l}  £  A  ■  Ih-kI^2  • 


Theorems  2  and  3  can  be  combined  to  give  a  relationship  between 
the  distances  d  and  A,  which  is  a  statement  about  square  roots  of 


matrices . 
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Theorem  4 

Let  H  and  K  be  two  n  x  n  positive  semidefinite  matrices,  and 
A  =  H1//2,  B  =  K1,/2,  then 

r1lA-Bi  <  Sh-kH  1/2  <  [2lA-BlMax (IaIJbI)  +  Ha-bI2]1/2 

n  —  — 

or 

Bh-kU/ [  {  IIh-kI!  +  Max(lHll,lKll))1/2  +  (Max  (IIhI  ,  IkI  ) ) 1/2] 

<  Ia-bI  <  a  Sh-kB1/2  , 

—  —  n 

where  l  =  k  =  2/2n(n+2). 
n  n 

This  theorem  means  that  the  square  root  satisfies  a  Lipschitz  condition 
on  the  cone  of  positive  semidefinite  matrices: 

iHV2-K1/2l  <  l  !h-kI  1/2  VH,K  €  p(Rn)  , 

—  n 

where  the  Lipschitz  constant  depends  only  upon  the  dimension  of  Rn; 

l  is  bounded  by  a  polynomial  of  degree  1  in  the  dimension  of  P(Rn) . 
n 

It  is  now  a  simple  matter  to  extend  Theorems  2,  3  and  4  to  the 
case  of  ellipsoids  not  necessarily  centered  at  the  origin. 

Theorem  5 

1/2  1/2 

Let  E=e+AS=e+H  s  and  F=f+BS=f+KS  be  two 
ellipsoids  in  Rn,  and  A,  B,  H  and  K  be  n  *  n  positive  semidefinite 
symmetric  matrices.  Denote  6  =  6(E,F),  d  =  d(E,F) ,  A  =  A(E,F)  and 
M  =  Max(lAl,lBl)  =  Max(lHl1/2,lKl1/2)  =  — ■  Max (D(E) ,D (F) ) ,  then  the 
following  inequalities  are  satisfied: 


i 
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<  d  <  (k  +1)6 

—  —  n 

<_  (d2+2dM)1/2 

<  Z  A 

—  n 

<_  6  +  (62+26M)1/2 

<  A 


Let  e  =  le-fll,  and  6  ,  d  ,  and  A  be  the  distances  between 

o  o  o 

E  -  e  and  F  -  f. 

One  has  d=d  +e,A=A  +  e  and, by  Lemma  1,  6  <  6  +  e,  e  <  6 

o  o  —  o  — 

and  6q  <_  6.  Hence  a  slight  difference  appears  in  the  proofs  for  the 
various  cases. 

For  instance.  Theorem  4  implies 

2  1/2 

A  <  (d  +  2d  M)  '  . 

o  —  o  o 

2  1/2 

Hence  A  *  A  +  e  <  (d  +  2d  M)  +  e;  the  maximum  of  the  right-hand 
o  —  o  o 

side  (subject  to  d  >  0,  e  >  0  and  e  +  d  =  d)  is  attained  for 
o  —  —  o 

e  =  0  and  d  =  d,  and  thus 

o 

A  <  (d2  +  2dM)1/2 


(k  +1) _1d  <  6 
n  — 

jf  1d  <  A 
n  — 

A2/o/2  +  M2  +  M)  <_  d 
6  <_  A 

A2/ (2 (M+A) )  <  6 

with  k  =  i  =  2i/2n(n+2)  . 
n  n 

Proof : 


or 


The  equivalent  result  from  Theorem  3  implies 


A  <  (<52  +  26  M)1/2  , 
o—o  o 

hence 

2  1/2 

A  =  A  +  e  <  (6  +26M)  +  e  ; 

o—oo 

and  the  maximum  of  the  right-hand  side  subject  to  e  6  and  6q  <_  6 
is  clearly  attained  for  e  =  6  and  =  6,  and  thus 

A  £  (62  +  26M)1/2  +  6 

or 

A2 

0  -  2 (M+6)  • 

The  other  cases  follow  similarly.  QED 

4.  Conclusion . 

Three  metrics  on  the  space  of  ellipsoids  have  been  shown  to  be 

linked  by  various  inequalities,  and  hence  the  induced  topologies  are 

identical.  Not  only  is  the  notion  of  convergence  unique,  but  rates  of 

convergence  can  be  related.  Similar  results  clearly  hold  if  the  Euclidean 

norm  is  replaced  by  any  of  the  L  norms. 

P 

If  k  and  l  were  defined  to  be  the  smallest  constants  satisfying 
n  n 

Theorems  2  and  4  (with  l  <  k  ) ,  it  would  be  quite  interesting  to  know 

n  —  n 

whether,  or  not,  they  must  depend  on  n,  the  dimension. 
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